arXiv:1509.05494vl [cs.DS] 18 Sep 2015 


FPTAS for Hardcore and Ising Models on Hypergraphs 


Pinyan Lu* Kuan Yang^ Chihao Zhang^ 


Abstract 

Hardcore and Ising models are two most important families of two state spin systems in 
statistic physics. Partition function of spin systems is the center concept in statistic physics 
which connects microscopic particles and their interactions with their macroscopic and statistical 
properties of materials such as energy, entropy, ferromagnetism, etc. If each local interaction of 
the system involves only two particles, the system can be described by a graph. In this case, 
fully polynomial-time approximation scheme (FPTAS) for computing the partition function of 
both hardcore and anti-ferromagnetic Ising model was designed up to the uniqueness condition 
of the system. These result are the best possible since approximately computing the partition 
function beyond this threshold is NP-hard. In this paper, we generalize these results to general 
physics systems, where each local interaction may involves multiple particles. Such systems are 
described by hypergraphs. For hardcore model, we also provide FPTAS up to the uniqueness 
condition, and for anti-ferromagnetic Ising model, we obtain FPTAS where a slightly stronger 
condition holds. 
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1 Introduction 


In recent couple of years, there are remarkable progress on designing approximate counting algo¬ 
rithms based on correlation decay approach [WeiOGl IBG081IGK121 lRST~*~lll ILLY121ISST121ILLY131 
ILY13t ILLL14t ILWZ141ILLZ141 ILL13b[ ILL15aj . Unlike the previous major approximate counting 
approach that based on random sampling such as Markov Chain Monte Carlo (MCMC) (see for 


examples [Ml IWM ICTTTTl ID.TVn21 IMhl |Vig991 ITTfM IDGOni ILVOT] ! . correlation decay 

based approach provides deterministic fully polynomial-time approximation scheme (FPTAS). New 
FPTASes were designed for a number of interesting combinatorial counting problems and computing 
partition functions for statistic physics systems, where partition function is a weighted counting 
function from the computational point of view. One most successful example is the algorithm 
for anti-ferromagnetic two-spin systems |LLY12( ISST12t ILLY13] , including counting independent 
sets |Wei06| . The correlation decay based FPTAS is beyond the best known MCMC based FPRAS 
and achieves the boundary of approximability |SS12t ICSV12| . 

In this paper, we generalize these results of anti-ferromagnetic two-spin systems to hypergraphs. 
For physics point of view, this corresponds to spin systems with higher order interactions, where 
each local interaction involves more than two particles. There are two main ingredients for the 
original algorithms and analysis on normal graphs (we will use the term normal graph for a graph 
to emphasize that it is not hypergraphs): (1) the construction of the self-avoiding walk tree by 
Weitz [Wein6| . which transform a general graph to a tree; (2) correlation decay proof for the tree, 
which enables one to truncate the tree to get a good approximation in polynomial time. However, 
the construction of the self-avoiding walk tree cannot be extended to hypergraphs, which is the 
main obstacle for the generalization. 

The most related previous work is counting independent sets for hypergraphs by Liu and 
Lu [LLlBbj . They established a computation tree with a two-layers recursive function instead 
of the self-avoiding walk tree and provided a FPTAS to count the number of independent sets for 
hypergraphs with maximum degree of 5, extending the algorithm for normal graph with the same 
degree bound. Their proof was significantly more complicated than the previous one due to the 
complication of the two-layers recursive function. In particular, the “right” degree bound for the 
problem is a real number between 5 and 6 if one allow fraction degree in some sense. This integer 
gap provides some room of flexibility and enables them to do some case-by-case numerical argument 
to complete the proof. However, the parameters for the anti-ferromagnetic two-spin systems on 
hypergraphs are real numbers. To get a sharp threshold, we do not have any room for numerical 
approximation. 


1.1 Our results 

We study two most important anti-ferromagnetic two-spin systems on hypergraphs: the hardcore 
model and the anti-ferromagnetic Ising model. The formal definitions of these two models can be 
found in Section [2j 

Our first result is an FPTAS to compute the partition function of hypergraph hardcore model. 


Theorem 1. For hardcore model with a constant activity parameter of X, there is an FPTAS to 

f A— 

compute the partition function for hypergraphs with maximum degree A >2 if X < ^ • 


This bound is exactly the uniqueness threshold for the hardcore on normal graphs. Thus, 
it is tight since normal graphs are special cases of hypergraphs. To approximately compute the 
partition function beyond this threshold is NP-hard. In particular. The FPTAS in [LL15b| for 
counting the number of independent sets for hypergraphs with maximum degree of 5 can be viewed 
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as a special case of our result with parameters A = 5, A = 1, which satisfies the above uniqueness 
condition. Another interesting special case is when A = 2. This is not an interesting case for normal 
graphs since a normal graph with maximum degree of 2 is simply a disjoint union of paths and 
cycles, whose partition function can be computed exactly. However, the problem becomes more 
complicated on hypergraphs: it can be interpreted as counting weighted edge covers on normal 
graphs by viewing vertices of degree two as edges and hyperedges as vertices. The exact counting 
of this problem is known to be ^P-complete and an FPTAS was found recently [LLZ14] . In our 
model, the uniqueness bound ^ (a- 2 )^ infinite for A = 2 and as a result we give an FPTAS for 
counting weighted edge covers for any constant edge weight A. This gives an alternative proof for 
the main result in |LLZ14] . 

Our second result is on computing the partition function of anti-ferromagnetic Ising model. 

Theorem 2. For Ising model with interaction parameter 0 < /3 < 1 and external field X, there 
is an FPTAS to compute the partition funetion for hypergraphs with maximum degree A if fi > 

1 - 2 

2e-i/2A-|-3‘ 

The tight uniqueness bound for anti-ferromagnetic Ising model on normal graphs is /3 > 1 — . 

So, our bound is in the same asymptotic order but a bit worse in the constant coefficient as 
2e“^/^ ~ 1.213 > 1. Moreover, our result can apply beyond Ising model to a larger family of 
anti-ferromagnetic two-spin systems on hypergraphs. 

1.2 Our techniques 

We also use the correlation decay approach. Although the framework of this method is standard, 
in many work along this line of research, new tools and techniques are developed to make this 
relatively new approach more powerful and widely applicable. This is indeed the case for the 
current paper as well. We summarize the new techniques we introduced here. 

For hardcore model, we replace the numerical case-by-case analysis by a monotone argument 
with respect to the edge size of the hypergraph which shows that the normal graphs with edge size 
of 2 is indeed the worst cases. This gives a tight bound for hardcore model. 

To handle hypergraph with unbounded edge sizes, we need to prove that the decay rate is much 
smaller for edges of larger size. Such effect is called computationally efficient correlation decay, 
which has been used in many previous works to obtain FPTASes for systems with unbounded 
degrees or edge sizes. In all those works, one sets a threshold for the parameter and proves different 
types of bounds for large and small ones separately. Such artificial separation gets a discontinuous 
bound which adds some complications in the proof and usually ends with a case-by-case discussion. 
In particular, this separation is not compatible with the above monotone argument. To overcome 
this, we propose a new uniform and smooth treatment for this by modifying the decay rate by 
a polynomial function of the edge size. After this modification, we only need to prove one single 
bound which automatically provides computationally efficient correlation. We believe that this idea 
is important and may find applications in other related problems. 

For the Ising model, the main difficulty is to get a computation tree as a replacement of the 
self-avoiding walk tree. We proposed one, which also works for general anti-ferromagnetic two- 
spin systems on hypergraphs. However, unlike the case of the hardcore model, the computation 
tree is not of perfect efficiency and this is the main reason that the bound we achieve in Theo¬ 
rem [2] is not tight. To get the computationally efficient correlation decay, we also use the above 
mentioned uniform and smooth treatment. We also extend our result beyond Ising to a family of 
anti-ferromagnetic two-spin systems on hypergraphs. 
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1.3 Discussion and open problems 

One obvious open question is to close the gap for Ising model, or more generally extend our work 
to anti-ferromagnetic two-spin systems on hypergraphs with better parameters. However, it seems 
that it is impossible to obtain a tight result in these models using the computation tree proposed 
in this paper, due to its imperfectness. How to overcome this is an important open question. 

Even for the hardcore model, our result is tight only for the family of all hypergraphs since the 
normal graphs are special cases. From both physics and combinatorics point of view, it would be 
very interesting to study the family of rc-uniform hypergraphs where each hyperedge is of the same 
size w. By our monotone argument, it is plausible to conjecture that one can get better bound 
for larger w. In particular, MCMC based approach does show that larger edge size helps: for 
hypergraph independent set with maximum degree of A and minimum edge size w, an FPRAS for 
w > 2A-|-1 was shown in [BDKOS) . However, their result is not tight. Can we get a tight bounds in 
terms of A and w by correlation decay approach? The high level idea sounds promising, but there 
is an obstacle to prove such result by our computation tree. To construct the computation tree, 
we need to construct modihed instances. In these modified instances, the size of a hyperedge may 
decrease to as low as 2. Therefore, even if we start with rc-uniform hypergraphs or hypergraphs 
with minimum edge size of u), we may need to handle the worst case of normal graphs during the 
analysis. How to avoid this effect is a major open question whose solution may have applications 
in many other problems. 

The fact that larger hyperedge size only makes the problem easier is not universally true for 
approximation counting. One interesting example is counting hypergraph matchings. FPTAS for 
counting 3D matchings of hypergraphs with maximum degree 4 is given in [LL15b] . and extension 
to weighted setting are studied in |YZ15j . In particular, a uniqueness condition in this setting is 
defined in [YZI5| . and it is a very interesting open question whether this uniqueness condition is 
also the transition boundary for approximability. 


2 Preliminaries 

A hypergraph G{y,£) consists of a vertex set V and a set of hyperedges £ C 2^. For every 
hyperedge e £ £ and vertex v £ V, we use e — v to denote e \ {u} and use e -|- u to denote e U {u}. 


2.1 Hypergraph hardcore model 

The hardcore model is parameterized by the activity parameter A > 0. Let G{V, £) be a hypergraph. 
An independent set of G is a vertex set / C Y such that e ^ / for every hyperedge e £ £. We use 
T{G) to denote the set of independent sets of G. The weight of an independent set I is defined as 
w{I) = We let Z{G) denote the partition function of G{V,£) in the hardcore model, which is 
defined as 

Z(G)A ^ ^(/). 

I£L{G) 

The weight of independent sets induces a Gibbs measure on G. For every I £Z, we use 


Prc [/] ^ 


w{I) 

Z{G) 
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to denote the probability of obtaining I if we sample according to the Gibbs measure. For every 
u G F, we use 

Prc [v e I]= ^ Pro [/] 

/eX(G) 

v£l 

to denote the marginal probability of v. 


2.2 Hypergraph two state spin model 

Now we give a formal definition to hypergraph two state spin systems. This model is parameterized 
by the external field A > 0. An instance of the model is a labeled hypergraph G{V,£, {(3,^)) where 
/ 3,7 : T —)• M are two labeling functions that assign each edge e G £ two reals /3(e), 7 (e). A 
configuration on G is an assignment u : P —>• {0,1} whose weight w{a) is defined as 


~ w{v,a) 

e£S v£V 

where for a hyperedge e = {vi,... ,Vw} 


w{e, a) = 


'f3{e) 

< 7(e) 

1 

\ 


if (t(ui) = a{v2) 
if (t(ui) = a{v2) 
otherwise 


= cr{vw) = 0 
= cr{vw) = 1 


and for a vertex v, 


w{v, a) = 


{: 


if (t{v) = 1 
otherwise. 


The partition function of the instance is given by 


Z{G)= ^(^)- 


Similarly, the weight of configurations induces a Gibbs measure on G. For every a G {0,1}^, we 
use 


Prc M = 


A w{I) 


Z{G) 


to denote the probability of a in the measure. For every u G P, we use 


Prc k(u) = 1] = ^ Prc [cr] 


cr(r;) = l 


to denote the marginal probability of v. 

The anti-ferromagnetic Ising model is the special case that /3 = /3(e) = 7 (e) < 1 for all e G £. 
In this model, we call /3 the interaction parameter of the model. The hardcore model introduced 
in previous section is the special case that /3(e) = 1 and 7 (e) = 0 for all e G £. 

We give the whole proof to Theorem [2] in appendix. More precisely, we design an FPTAS for 
the more general two state spin system and establish the following theorem: 
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Theorem 3. Consider a class of two state spin system with external field A such that each instance 
G{V,S, (/3,7)) in the class satisfies 1 — 26 - 1 / 2 a +3 ^ /3(e)) 7(e) ^ 1 where A is the maximum degree 
of G. There exists an FPTAS to compute the partition function for every instance in the class. 

Theorem [2] then follows since it is a special case of Theorem [3J 

Actually, the main idea of FPTAS design and proof for this model is similar to the idea we use to 
solve hypergraph hardcore model. However, the details of recursion function design and techniques 
for proof of correlation decay property are pretty different from that in hypergraph hardcore model, 
so we put the whole section in appendix. 


3 Hypergraph Hardcore Model 


3.1 Recursion for computing marginal probability 


We first fix some notations on graph modification specific to hypergraph independent set. Let 
G{V,8) be a hypergraph. 

• For every u G P, we denote G — v = {V \ {u} , S') where S' = {e \ {u} | e G S}. 

• For every e G £1, we denote G — e = (V,S \ {e}). 

• Let X be a vertex or an edge and y be a vertex or an edge, we denote G — x — y = {G — x) — y. 

• Let S = {ui,..., Vk} C V, we denote G — S = G — vi — V 2 ■■■ — v^. 

• Let T = {ei,..., e*,} C S, we denote G — T = G — e\ — 02 - — e^. 


Let G{y,S) be a hypergraph and u G P be an arbitrary vertex with degree d. Let {ei,... ,6^} 
be the set of hyperedges incident to v and for every i G [d], = {u} U {vij \ j G [tCj]} consists of 

Wi + 1 vertices. 

We first define a graph G'{V',S'), which is the graph obtained from G by replacing u by d 
copies of itself and each contains a distinct copy. Formally, P' A \ {i;}) u {ui,...,Ud}, 
S' = {e ^ S \ V ^ e} Li {ci — V + Vi \ i ^ [d]}. 

For every i G [d] and j G [wi], we define a hypergraph GijiVij^Sij): 

Gij = G' - [vk \ i < k < d} - {ck \ I < k < i} - {vik \ l<k < j} . 


Let R,, = 


PrclnS/] 


“ Frc WP 

Lemma 4. 


and Rij = ■ We can compute Ry by following recursion: 


Rv = 


i-ni 


Ri 


i=i \ j=i 

The proof of this lemma is postponed to appendix. 


+ R. 


( 1 ) 


V 


The Uniqueness Condition Let the underlying graph be an infinite d-ary tree, then the recur¬ 
sion ([H) becomes 


fxA^) = ^ 


1 -|- X 


Let X be the positive fixed-point of fx^fix), i.e., x > 0 and fx,d{x) = x. The condition on A for the 


uniqueness of the Gibbs measure is that 


fxA^) 


< 1. The following proposition is well-known. 
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Proposition 5. Let A, 


(d_t)^+i ; 




1 and for every 0 < X < Xc, it holds that 




< 1 . 


3.2 The algorithm to compute marginal probability 

Let G{V,£) be a hypergraph with maximum degree A and n G P be an arbitrary vertex with 
degree d. Define Gij , , Rij as in Section 13.11 Then the recursion ([T]) gives a way to compute the 

marginal probability Prc [v £ I] exactly. However, an exact evaluation of the recursion requires a 
computation tree with exponential size. Thus we introduce the following truncated version of the 
recursion, with respect to constants c > 0 and 0 < a < 1. 


R{G,v,L) 


'mti (i 
' mti(i 


n wi R{Gij ,Vij ,L) \ 

j=l l+R{Gij,Vij,L)) 

J = 1 l + R(Gij ,Vij ,L-\l+c\og^i ^Wi\) ) 


if d = A 

if d < A and L > 0 
otherwise. 


The recursion can be directly used to compute R{G, v, L) for any given L and it induces a 
truncated computation tree (with height L in some special metric). It is worth noting that, the 
case that d = A can only happen at the root of the computation tree, since in each smaller instance, 
the degree of Vij is decreased by at least one. 

We claim that R{G, v, L) is a good estimate of Ry with a suitable choice of c and a, for those 
(A, A) in the uniqueness region. 

Lemma 6 . Let G{V,£) be a hypergraph with maximum degree A > 2. Let v £V he a vertex with 

(A— 

degree d and let A < Ac = ^ (a- 2 )^ activity parameter. There exist constants G > 0 (more 

precisely, G = GAvT+Tj and a G (0,1) such that 

\R{G, V, L) - Ry\ < G ■ 


for every L. 

The whole proof of this lemma is postponed to the next section. 

Proof of Theorem Q Assuming Lemma El the proof of Theorem [T] is routine and we put the proof 
into appendix. □ 


3.3 Correlation decay 

In this section, we establish Lemma El We first prove some technical lemmas. 

Suppose / : ^ M is a d-ary function where D C M is a convex set, let (/) : M —)• M be an 

increasing differentiable function and <h(x) = (j)\x). The following proposition is a consequence of 
the mean value theorem: 


Proposition 7. For every x = (xi,..., x^), x = (xi,..., x^) G it holds that 


1 . 

2 . 


l/(x) - /(x)| = ^ |(/'(/(x)) - -^(/(x))| for some x G D; 


l<^(/(x)) - <^(/(x))| < ^ 


9/(S) 


dxi 


(xi) — 4>{xi)\ for some x 


(xi,... ,Xd) G D^. 
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(A— 

Lemma 8. Let A >2 be a constant integer and A < Ac = ^ (a- 2 )^ ® constant real. Let d < A 

and wi,... ,Wd > 0 be integers and / = A OiLi (i - njii « (e t=i -o.'^y function. 

Let = —/==^. Let c < min | log “ 1-} ® positive number. There 

exists a constant a <1 depending on A and d (but not depending on Wi for all i G [d]) such that 




Hf) 


5/(x) 


a=l b=l ^ 

for every x = {xij)i^\^d],j&[wi] where each Xij G [0, A] 


dxab 


< a < 1 


The lemma bounds the amortized decay rate, which is the key to the proof of correlation decay. 
In previous works, the amortized decay rate is defined as 


d Wa 

EE 

a=l b=l 


Hf) 

^{Xab) 


5/(x) 


dx. 


ab 


without the w'^ factor. Then one need to give a constant a < 1 bound for small Wa and a sub 
constant bound for large Wa. With this modification, we only need to prove a single bound as 
above. 

Notice that we require c to be a positive constant, so it is necessary to verify that log (^^) — 
1 > 0 for every A > 0. To see this, let h{X) = log (1^) — 1, then we can compute that 


h'{X) 

h"{X) 



1 


2A2(1 + A)2‘ 


1 + 2A 
2A + 2A2 ’ 


Since h"{X) > 0 for every A, h'(A) is increasing. Along with the fact that lim^^oo = 0, we 
have h'[X) < 0 for every A > 0. This implies that h{X) is decreasing. Also note that 


lim hiX) 

A^oo 


lim log 

A^cxd 



-1 = 0 . 


It holds that h{X) > 0 for every A > 0. Thus a positive c satisfying c < /i(A) exists for every A > 0. 
Proof of Lemma\^ To simplify the notation, we first let tij = then for every i G [d] and 

j G [rcj], it holds that tij G 0, and 


/ — Aj 1 Wtij 
i=i 


2=1 


For every a G [d] and b G [rcj], we have 

df 


dx 


ab 


A(1 - tabf JJ ^aj ■ Yl [l-YlUj \ = f 

i=i 




ie[d] 

i^a 


(1 - tabf 

^ab 


07=1 ta, 

1-07=0./ 


7 





























Thus 




Hf) 

Let t , define 


df 


dx, 


ab 


f ^<Y\J=ltaj ^l-tab 


^ T-i ^ 


E 


A / f '^a 0^ = 1 ^aj ^ 1 — tab 

"“'^VTTrgwTfT-E^ 


Anti(i-n7ii*« 


E 


i-u 


-E 


\ 1+A n?=i (i - nji. *.;) ' - nj" *« tr 


For every t = {tij)i(zid]j(z[wi] where each Uj G [0, define a tuple t = {iij)i(zid]j(zwi such that for 
every i G [d], 

ifj = i 

otherwise. 


tij — 


X 

l+A 


We claim that h{t) < h{i). To see this, first note that for every i G [d], 07=1 
sufficient to prove that for every i G [d] 

^ 1 - fi,- ^ 1 - iij 

Ew5#sE-^ 


vm 


i=l \ ti 


This is a consequence of the Karamata’s inequality by noticing that the function -^- 7 = is convex 
We rename tn to U and it is sufficient to upper bound 


5r(t,w) = 




An?=,(i-(iG 


Wi-l 


i+Anr=i(i-(TTA 


Wi-l 


E 




i V l+A 


Wi-l 




Wi-l 


I- tj {Wj - 1) 

\/^ VA + 


( 2 ) 


0, and Wi G for every i G [d]. 


where ti G 

The argument so far is similar to the proof in |LL15b| . In the following, we prove a monotonicity 
property of each Wi and thus avoid the heavy numerical analysis in |LL15bj and allow us to obtain 
a tight result. 

( \ Wi — 1 w — \ 

1 ti and thus equivalently U = {1 — Zi) (^-) 

For every fixed z = (zi,..., Zd), we can write ([2]) as 


9z(w) = 


' Anti^. 

l+A n^=i Zi 


E 


1 — Zi /1 — t. 


+ 


Wi - 1 


\/ti VA + 


Wi . 


(3) 


We show that g^iy^) is monotonically decreasing with Wi for every i G [d] 

_l_ {Wj- 

^ x/aT 

<9ffz(w 


Denote Tj = then 

* VU VA+A^ ’ 


dwi 


Aa=i+ 1 + cwr^Ti 


l+A ni=i Zi 


Zi 


dwi 


(4) 














































The partial derivative (jj]) is negative for a suitable choice of c: 


l-Zi {dTi 

- 

Zi \dzi ^ 
1 - Zi 


Zi 

1 - z, 






_i (l-ti {Wi- 1) 


* c-l 
• W, 


Zi 


1 




\/^ VA + 

+ ‘ VaTa^ 


_ 1 - ,„C -1 (c + l)u;^ - c / 1/2 / 1 




Zi 

Denote 


VaTa^ 


- t/ -ICilog 


1 + A 
A 


+ c] [ -Wi log 


1 


1 + A 


— c 


?(*•“’> - +*“a^ ‘ (+‘”® (^) (+‘”® 


1 + A 


— c 


Since c < the term 


(^^wlog 


1 + A 


achieves its minimum at t = i^- Thus 


p{t, w) < p 


1 + A’ 


w = 


+ C I + t 


1/2 


- 1/2 


- w log 


1 + A 


— c 


1 + A 


c + 1 2A + 1 /1 + A 


2A 


log 


w. 


Moreover, c < log — 1 implies that ^ log holds, which consequently 

leads to p 1 ^ < 0. 

In all, we choose a positive constant c < min | log ~ results 


inp(Tq:x,iu) <p(i^,l) < 0. 


1+A> 


In light of the monotonicity of lu/s, for every fixed z, 5 z(w) achieves its maximum when w = 1. 
Thus 


max g{t, w) = 


max 

z={zi,...,Zd) 

Vie[d],^ie[i-(i^)”»“\i] 


S'zCw) < max gz{l) < max gz{l). 

z={zi,...,Zd) zelo,!]"^ 

Vie[<i],^ie[i-(y^)“'"\i] 


Actually, the case that all lu/s are 1 corresponds to counting weighted independent sets on 
normal graphs and arguments to bound g'z(l) can be found in |LLY13j . For the sake of completeness, 
we give a proof of g'z(l) < a < 1 (Lemma [9]) in appendix. □ 

f A — 

Lemma 9. Let A > 1, be a constant. Assume A < Ac = ^ (a- 2 )^ ® constant and d < A. Then 

for some constant a < 1, 5z(l) < a < 1 where z = (zi,..., Zd) G [0,1]'’*. 

We are now ready to prove the main lemma. 

Proof of LemmalBi Let <I>(x) = , ^ and ^(x) = f <I>(x)dx = 2sinh“^(Y^). We first apply 

induction on £ = max{0, L} to show that, if d < A, then \c/){Ru) — (j){R{G,v, L))\ < 2\fXa^ for 
some constant a < 1. 
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If £ = 0, note that Ry E [0, A], thus \cj){R{G,v, L)) — cl){Ry)\ < 2^/X. We now assume L = i > 0 
and the lemma holds for smaller i. For every i E [d] and j E [wi]^ we denote Xij = Rij and 
Xij R{Gij ^Vij ^ L [1 “1“ ^ loSi/cK *^ 2 ]) ■ Let x x Let f 

Anti (i-njiiT^) , then it follows from Proposition [7] that for some x = jg[^.] with 

each Xij E [0, A] 


d Wi 


\<PiR,)-mG,v,L))\ < EE 




dfii) 


dx 




■ \4>ixij) - Hxij)\ 


i=i j=i ^ 

< 2VAa^. 


5/(x) 


dx. 




a 


L-Ll+clogi/^ij)iJ 


(4^) follows from the induction hypothesis and (^) is due to Lemma [HI 

The case that d = A can only happen at the root of our computational tree. Following the 
arguments in the proofs of [HI [9| and the bound in ([5]) , it is easy to see that a universal constant 
upper bound for the error contraction exists, i.e., 


A Wi 

EE 


i=l j=l 


Hf) 

^{Xij) 


5/(x) ^ / A^{A — — z) 

^ ™] V (A - 2)^ + (A - 


Thus \(l){Ry) — (j){R{G,v,L))\ < 6\/Aa^ for every v. 

Then the lemma follows from Proposition [7[ since 

\Ri, - R{G, u, L)| = ^ • \(t>{Ri,) - cj,{R{G, v, L))\ 
9{x) 

< 6AV1 + A • 


for some x E [0, A] 


□ 
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A Proof of Theorem [T] 


Proof. The input of the FPTAS is an instance G{V,£) and an accuracy parameter 0 < e < 1/2. 
Assume V = {ui,..., Vn}. Note that / = 0 is an independent set of G with w{I) = 1. Therefore 


Z{G) = I/Ptg [I] 



l\vi^I 

.i=l 


-1 


/ n 


2—1 

(RP'-g 

Vi ^ I 

1_ 


-1 


For every 1 < z < n, we define a graph Gi{Vi,Ei)\ 

• Gi = G; 

• For every i > 2, Gj = Gj_i — Uj_i — £' where T' = {e G Ti_i | Uj_i G e} consists of edges in 
Gi-i incident to u*. 


It is straightforward to verify that Prc 
Thus, 


Vi ^ I Aj=i '^j ^ ^ [vi 0 I] for every 1 < z < n. 

n 

Z{G) = n (Prc. [v^ 0 /])-' = n (1 + , 


2 = 1 


2 = 1 


where Ri = Let G and a be constants in Lemma [H We compute R{Gi,Vi,L) with 


^YG^[vNI] 

L = ^ for every 1 < z < n, then 


\Ri ~ R{Gi,Vi,L)\ < 


2n 
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This implies 


E 1 “h -^2 E 

1-< -^- - -r < IH-• 

2re l + R{G,Vi,L) 2n 

Let Z = nr=i (1 + R{Gi,Vi, L))~^ be our estimate of the partition function, then it holds that 

r Z{G) 
e"^ < —^ 

Z 

It remains to bound the running time of our algorithm. Let T{L) denote the maximum running 
time of computing R{G,v,L) (over all choices of d < A and arbitrary Wi). Then by the definition 
of R{G,v,L), for every L > 0, 

d Wi 

^ E E - LI + clogi/„ w ,\) + 0(n). 
i=lj=l 

It is easy to verify that T{L) = for our choice of L. Thus our algorithm is an 

FPTAS for computing Z(G). □ 

B Proof of Lemma [4] 

Proof. By the definition of Ry, we have 


_ Prc b € /] _ 

" Praiv^I] 

For every i G [d], define Gi = G' — {vk \ i < k < d] — {e^ | 1 < A; < z}, we have 


Prc' 

Ati Vi el 

d- Prc”/ 

\ TT 

Viei/\ A}=\ Vj^i A Aj=i+1 Vj 

G I 

Prc' 


- A 11 

*=i Prc^ 

Vi^I A A}=1 Vj^I A Aj=i+1 Vj 

G / 


Prc' 

ViGl A A;=\ Vi^ I a A?=i+1 Vj G I 

Prc' 

Vi e I 

A5=Ei 0^AAE+i^f 

Prc, [vi G I] 

Prc' 

Vi^I A A}=1 Vj^I A Aj=i+i Vj G I 

Prc' 

Vi ^ I 

A}=1 Vj^I A Aj=i+1 Vj G / 

Prci [vi ^ 1\ 


This is because fixing Vj G / is equivalent to removing Vj from the graph and fixing Vj 0 / is 
equivalent to removing all edges incident to Vj from the graph. 

Since e* is the unique hyperedge in Gi that contains Uj, we have 


Prc, [vj G /] 
PrCi [vi ^ /] 


— 1 Prc;^_^,^_ej 


(\ % ^ ^ 

i=i 


i-nprG,,[%G/]=i-n 

i=i j=i 


Ri 


1 + Rij 


□ 


C Proof of Lemma [9] 

Proof. Let A(. = be the uniqueness threshold for the d-ary tree. Then A < Ac < A'c. 

Plugging w = 1 into ([3]), we have 


5z(l) = 


^ ni=i 




1+ni=i i=i 


- Zi. 


13 



























Let z = it follows from Jensen’s inequality that 

5 r(t,l) < d 


' {I — z) 
1 + Xz^ 


< d\ 


X'^z‘^{l - z) 
1 + X'z<^ 


(5) 


Recall that f\^d{x) = A • Let x be the positive fixed-point of fy^^dix) and z = We show 

that achieves its maximum when z = z. The derivative of with respect to z 

is 

X',z<^{l-z)\' 


1 X’z^ 


/ ^d—1 


A'z' 


(1 + X’,zd) 


(^z + X'^z'^^^ - d{l - z)^ . 


Since A'^ = 


(rf_i)<^+i ; the above achieves maximum at z = If we let x = then it is easy to 
verify that f\'^^d{x) = x, which implies z = z because of the uniqueness of the positive fixed-point. 
Therefore, we have for some a < 1, 


fl'z(l) <a<d\ 


I X'^z'^il — z) 
1 -|- X'z^ 




= 1 . 


□ 


D FPTAS for Hypergraph Ising Model 

D.l The algorithm and recursion for computing marginal probability 

In this section, we give the recursion function and design an algorithm to compute marginal prob¬ 
ability in hypergraph Ising Model. Then we prove that the algorithm is indeed an FPTAS for any 
instance G(V,£:, (/3,'y)} if 1 - < /3(e), 7 (e) < 1. 

Graph Operations We first fix some notations on graph modification specific to our hypergraph 
two state spin model. Let G(F, T, (/ 3 , 7 )) be an instance. The first groups of operations are about 
vertex removal and edge removal, which is similar to the case of hardcore model: 

• For every r G F, we denote G — v = {V \ {u} (/ 3 ', 7 ')) where £' = {e — v \ e ^ and 

f3'{e — v) = /3(e), 7 '(e — v) = 7 (e) for every e G £.. 

• For every e G T, we denote G — e = {V,£ \ {e} , (/3, 7 )). 

• Let X be a vertex or an edge and y be a vertex or an edge, we denote G — x — y = {G — x) — y. 

• Let S = {ui,..., vjX] C V, we denote G — S = G — vi — V 2 ■ ■ ■ — Vk- 

• Let T = {ei,..., e^} C T, we denote G — T = G — ei — 62 ■■■ — ek- 

The second group of operations is about pinning the value of a vertex, whose effect is to change 

/3(e) or 7 (e) for edge e incident to it. 
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• Let v G y be a vertex, we denote G|t,=o = (L^\{'y} , {P\l')e&S') where = {e — n | e G 8 }, 
P'{e — v) = /3(e) for every e £ 8 and 

/. X A / 7 (e) if 0 e 
7 (e - n) = < 

I 1 otherwise. 

This operation is to pin the value of v to 0. 

• Similarly, for a vertex v £V,we denote G|„=i = (V^\{u} , 8', (/3', 7 ')) where T' = {e \ {u} | e G T}, 
7 '(e — v) = 7 (e) for every e £ 8 and 

R'( - //5(e) if 0 e 

^ ^ ^ |l otherwise. 

This operation is to pin the value of u to 1. 

• Let u,v £ V he two vertices and i,j £ {0,1}. We denote G\u=i,v=j — {G\u=i) \v=j and this 
notation generalizes to more vertices. 


• Let S = {vi,... ,Vk} C V, we use ^15=0 (resp. G|s’=i) to denote G|^^=o,v 2 =o,..., 1)^=0 and 

Let G{V, 8 , (/3,7)) be an instance and u G F be an arbitrary vertex with degree d. Let E{v) = 
{ei,..., Sd} be the set of edges incident to v. For every i £ [d], we assume e* = {u} U {vij I J e K]} 
consists of Wi + 1 vertices where Wi > 0 . 

We define a new instance G'(y',T', (/3g, 7 ')) which is obtained from G by replacing u by d 
copies of itself and each e* contains a distinct copy. Formally, W = (1/ \ {u}) U {vi,... ,Vd} and 
8' = {8 \ E{v)) £1 {ci — V + Vi \ i £ [d]}; /3'(e) = /3(e), 7 '(e) = 7 (e) for every e £ 8 \ E{v) and 
/3'(ei -v + Vi)= (3{ei), 7 '(ei - v + Vi) = 7 ( 6 *) for every i£ [d]. 

For every i £ [d] and j £ [rcj], we define two smaller instances G^j ^ ^ij^ 

G,/(7,4, (Ay 7/)): 

• - (((G'V<,=o)|y>i=i) - ei)|yi^^o; 

• = (((GV<,=o)|y>i=i) - ei)|yi^^i, 


where l/<i = {ufc | A: < i}, L>i = {vk \ k > i}, = {vik \ k < j}. 

We now define the ratio of the probability on instances defined above. 


Let K = 

^ PrG'[cr(Li)=0 ’ 


For every i £ [d] and j £ [rcj], let = 


Pr^O [o-(i^ii)=l] 

_ d1 ^ _ 

Fr^o [o'{«ii)=0] ’ b Pi'gI [o'{'^o)=0] ■ 


Pr^l [a(vij)=l] 
^3 


It follows from our definition that for every i G [d], R^i = Rh- 
We can compute Ry by the following recursion: 


Lemma 10. 


Rv = 




il-(l-7(e.)).i||;-n" 


j=2T+Ej; 


=1 1 - (1 - /5(ei))T7w 117=2 ttrT 


( 6 ) 
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Proof. By the definition of we have 


Pfg [cr(u) = 1] ^ P’^G' 

Af=l(T{Vi) = 1 

- - A-l 

d 

n 

j. Prc' 

a{vi) = 1 A A}=\ cr{vj) = 0 A Aj=i+i = 1 

PrG [ct(u) = 0] ' 

O 

II 

b 

< 

^ J 

i 

iprc' 

a{vi) = 0 A A}=1 cr(vj) = 0 A Aj=i+i ^(vj) = 1 


For every i £ [d], dehne Gi = (G'|v<.=o)|vSi=i, then 


PrG' 

a{vi) = 1 A A}=\ (^{vj) = 0 A Aj=i+i = 1 

PrG' 

a{vi) = 1 

A}=i = 0 A Ai=i+i = 1 

PrG' 

a{vi) = 0 A A}=1 (T{vj) = 0 A Aj=i+i ^(vj) = 1 

PrG' 

Pro. 

a{vi) = 0 

a{vi) = 1] 

A}=1 = 0 A Aj=i+i = 1 


Prc, [(T{vi) = 0] ■ 

Since is the unique edge in Gi that contains Uj, we have 


'y{ei)PrGi-vi-ei 

A7ii = 1 

+ 

1 P^Gi—Vi—Ci 

A7ii ^(%) = 1 

) 

P{ei)PrGi-vi-ei 

A7ii = 0 

+ 

1 '^^Gi—Vi—ei 

A7=ii'^(%) = 0 

) 


1 - (1 - 7(ei))PrGi-,;i-ei [cr{vii) = 1] • 07=12 PrCi-^i-e^ 

a{vij) = 1 

Ai=l cr{vk) = l 

1 - (1 - P{ei))PYGi-Vi-ei [(y{Vil) = 0] • 07=12 ^^Gi-Vi-Ci 

a{vij) = 0 

Ai~\ a{vk) = 0 


1 - (1 - 7(ei))Prc.i^ [cr{vii) = 1] • 07=2 [^(%) = 1] 

1 - (1 - /3(ei))PrG0 [a{vii) = 0] • 0712 P^go [a{vij) = 0] 


l-(l- 7 (ei)) 


1+K“i i ii=2 l+Ri, 




1 (1 /3(ej))^^^o I\j=2 i+RO 


The last equality is due to the fact that = Rj^. 


□ 


The algorithm description is similar to Section Let G{V,£, be an instance of our 

two state spin model with maximum degree A, and u G F be an arbitrary vertex with degree d. 
Let E{v) = {ei,... ,6^} denote the set of edges incident to v. Define G^^, Gh, Ry, R^j, Rjj as in 
Section [D1 Then the recursion Q gives a way to compute the marginal probability PfG [o'iv) = 1] 
exactly. However, an exact evaluation of the recursion requires a computation tree with exponential 
size. Thus we introduce the following truncated version of the recursion, with respect to constants 
c > 0 and 0 < a < 1. Let 


/gw=^ • n y 


1 - (1 -7(ei)) 




n 


Wi ' ij 

i=2 1+rf 


1 - (1 - /3(ei)) 


1+F 


n 


J=2 1+^ 


where r A ((r0.)i<j<^,, irlj)2<j<wi)ield] with 

Vij R{Gij , Vij , L [1 T c log^^^Q '^i \) 
rjj = R{G}j ,Vij,L-ll + c logi/„ Wi\ ). 
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We can describe our truncated recursion as follows: 


R{G,v,L) 


fair) if L > 0 
A otherwise. 


The recursion can be directly used to compute R{G, v, L) for any given L and it induces a 
truncated computation tree (with height L in some special metric). 

We claim that R{G, v, L) is a good estimate of Ry for a suitable choice of c and a, for those 
(/ 3 , 7 , A) satisfying that 1 - < 1 for all e E T. 

Lemma 11. Let Giy^ T, (/3, 7 )) he an instance of our generalized two state spin system model with 
maximum degree A > 2. Let v ^ V he a vertex and assume 1 — 2 e-i/ 2 A +3 — /^(®)’T(e) ^ 1 for all 
e G £. There exist constants G > 0 and 0 < a < 1 such that 

\R{G, v,L) - Ry\<G ■ 


for every L. 

The Lemma fTTl will be proved in the next section. The proof of Theorem [3] with this lemma is 
almost identical to the proof of Theorem [1] and we omit it here. 


D.2 Correlation decay 

Again, the key is to bound the amortized decay rate as in the following lemma. 

Lemma 12. Let A >2 be a constant integer. Suppose d < A is a constant integer, A E (0, l),/3c = 
1 — 2e-i/2^+3 constant real numbers and 71,72,... 7^, /3i, /32, • • •, /Sd E [/3c, !]• Let wi,... ,Wd > 0 
be integers and 


/(r) = Anr7r^rAr^^ 

.^1 i-(i-11^.^217^ 


be a -ory function. Let ^>(x) = There exist constants a < 1 and c > 0 depending on 

7 and A (but not depending on Wi) such that 




2=1 




df{r) 


dr^- 


+ E 


Hf) 


i=2 


9/(r) 


(9rh 


< a < 1 


for every r = {rij)i^\d],j&[wi] E [A/3^, A/3, 


-Ai 


Proof. We first let Xi = all 1 < i < d and 2 < j < Wi. The it holds 


that Xi,yij,Zij E 


A/3/^ A 

1+7^’ A+^ 


IJ ' IJ 

. To simplify the notation, we denote 


Wi 


Ai = l- {1- '-fi)xi P 


Vij 


3=2 




- Z, 


■ 1 ]) 


3=2 
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where Ai e [ 7 *, 1] C [j3c, 1],-B* G [/?*, 1] C [j3c, 1]. 
Then we can write / as 


/ = An 


i=l 


A 

Bi 


We can directly compute the partial derivatives of /, which yields the following for all i G [d] and 
2 < j < Wi: 


dr^i 


( \ 

. keld] ^ . 

\ / 


(1 - Xj) ((1 - Ai){l - Bj) - (1 - Xi){l - Aj) - Xi{l - Bj)) 

XiBf 


= f 


9rh 


9r0. 


/ 


(1 - Xj) ((1 - Ai){l - Bj) - (1 - Xi){l - Aj) - Xi{l - Bj)) ^ 
-(1 - Vijfjl - Aj) ^ ^ ^ Aj) ^ 

Vij Bi yij Ai 


\ 


. keld] ^ , 

\ k^i / 

/ \ 

. ke[d] , 

\ kj^i / 


-Ai{l - Bi){l - Zjj) _ ^ -(1 - Bi){l - Zjj) 


B? 


Bi 


Thus, 

d 


Wi 




i=l \j 
d 

W, 


df{r)\ ^ <!>(/) 


dr^. 


df{r) 


1 


E 


/(r) ^ M 1 - a;* 


df{r) 


dr^i 


Wi 


1 — Vi drh ^ 1 




a/(r) 


i=2 


Vi 


drj. 


Wi 


i=2 


- 2 : 7 : 


a/(r) 


9r0. 


d 

= '^W7 
2=1 


— (1 — ^7)(1 — Bi) + (1 — Xi){l — Ai) + Xi(l — Bi) 1 — Ai 


AiBi 


i=2 


1 - Bi 


E- 

i=2 


Let yi = {]\%2 Vij 


l/{Wi-l) 




■IJ 


l/(77;i-l) 


for every i G [d], then it holds that 


21 * = 1 - (1 - li)xiy^^ \ 


Bi = l-{1-I3i){l-Xi){l-Zi)^^ 


Wi — 1 


^(1 - Vij) < (wi - 1)(1 - Vi) 
i=2 

Wi 

y^^zjj < (wi - i)zi. 
i=2 
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Since Ai, Bi E [f3c, 1] for every i £ [d], we have 


i=l 

d 

i=l 

d 


+ 


A. 


-(1 - Ai){l - Bj) + (1 - Xi){l - Aj) + Xi{l - B j) ^ 1 - A, 
(1 - Xi)(l - Aj) + Xi(l - Bj) - (1 - Ai){l - Bj) 

AiBi 

(1 - Xi){l - Ai) + Xi{l - Bi) 




i=2 


B, 

* i=2 


+ (wi - 1) 


(1 - Ai){l - ^ (1 - Bi)zi 


Ai 


Bi 


2 = 1 


AiBi 


+ (1 - /3c)iu)i - 1 ) 


XiVp ^{1-yi) ^ {I - X i){l - Zj)^^ ^Zi 


Ai 


Bi 


I-Pc 
- P^c 


a 

((1 - Xi)xi{y'P^~^ + (1 - Zi)^"~^) + Pciwi - - yi) + (1 - Xi){l - Zi)‘^^~^Zi)^ 


2=1 


We now assume Lemma [T3l thus there exist constants a < 1, c > 0 depending on A and A such 


that 


Wi ^(1 - Xi)xi{y'^^ ^ + (1 - Zi)'^" + Pciwi - l)ixiyp ^(1 - yi) + (1 - Xi){l - Zi)'^^ ^Zi)'^ < aPce‘^P<^ 

for every i E [d]. Thus, 


-1 


E 

2=1 


— (1 — Ai)[l — Bi) + (1 — Xj)(l — Ai) + Xj(l — Bi) 1 — A. 


Wi 


AiBi 


+ 


l-Bi 


Wi 


E(i-!/.i)+V^E 


i=2 


i=2 


Pc 

^ 2ad ^ 2e ^/‘^d + 3 ^ (i_ 2 /( 2 e-i/ 2 rf+ 3 ))-i/ 2 -i 
“ 2e-V2d + 3 ’ 2e-V2d + l ' 


2d 


= a 


< a. 


2e-V2d + 1 


• e 


(l-2/(2e-i/2rf+3))-i/2-l 


The last inequality is due to the fact that h[d) = — -V 2 rf+i ' ^^^d+3)) V2 1 is an increasing 

function on d and lim^^oo h{d) = 1. 

Combining all above, there exist constants a < 1 and c > 0 such that for all tci, rc 2 ,... rcrf > 0 
and every r = (rij)jg[rf]with each E [XP^,XP~^], it holds 


E 

2=1 


W, 


•^if) 


i=i '' 




dfir) 


dr^. 


Hf) 
jH 


+ E 


df{r) 


dr^. 


< a < 1 


□ 


It remains to prove Lemma [T3l 

Lemma 13. For all P < 1 and 0 < 6 < 1/2, there exist constants a < 1 and c > 0 such that 

((1 - x)x{y^-^ + (1 - z)^-^) + P{w - l)xy^-\l - y) + P{w - 1)(1 - x)(l - z)^-^z) < a/3e^"^ 
for all w G'H and all x,y,z £ [d, 1 — d]. 
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Proof. For a fixed w, let 


Vwix,y,z) = {1 - x)x{y'" ^ + (1 - z)"' ^) + (3{w - l)xy'^ ^{1 - y) + (3{w - 1){1 - x){l - z)'" 

Then Vw{x,y, z) achieves maximum value when 

^/3{w-l) + l-x l-(l-x)//3 

y = yc = -^-= 1 - 


Z = Zc = I — 


(5w w 

/3{w — 1) + X _ 1 — x/f3 
^ ^ ■ 


w 


If y < 1 — ^ ^ V^wix,y,z) is an increasing function on y. If z > Vw{x,y,z) is a 

decreasing function on z. 

Let w = max | |"j] , ^ monotonicity of Vw(x, y, z) implies that the 

function achieves it maximum when the y and z are at the boundary, i.e., y = l — z = l — d, for 
every fixed x. 

We now analyze the case w < w and the case w > w separately. Define a = ^ ^\i{ 2 fi)-\ 

It is easy to verify that a <1 since (1 + x/n)” < e* for every x > 0. 

• (If rc < w.) We plug y = yc and z = Zc into Vu,{x, y, z): 

Vnj{x,y,z) < {l-x)x{yf~^ + {l-Zcr~^)+l3{w-l)xyf~^{l-yc)+l3{w-l){l-x){l-Zcr~^Zc. 

The derivative of the right hand side with respect to x is 

{l3{w — 1) + 1 — x)"'“^(l + I3{w — 1) — (tc + l)x) — {l3{w — 1) + x)"'“^(l + /3{w — 1) — (rc + 1)(1 — x)) 

{(3w)^ ' 

It is easy to see that the function above is zero when x = 1/2 and positive for smaller x, 

negative for larger x. 

Thus, when x = l/2,y = y^ z = Zc, 14; (x, y, z) achieves its maximum value 


\ 2 w w 


= (3 1 - 


1 _ J-' 
f ^ 
w 


</3 1 - 


1 _ J-' 
f ^ 
w 


< /3e2/3 ^ 


Let Cl 4 log^ 


1 -/ 112 . 


^ ^ = — log^ a > 0 , then for all re < 4 and c' G ( 0 , ci]. 


Vy,{x,y,z) <w''^Vwix,y,z) <w'^^l3 1- 


-I 1 \ '^ 

^ _ /? 


w 


1 - - 
a \ w 


1 - 

2/3 \ 




(If w > w.) Let C 2 = —rt;log(l — d) — 1 > 0. Then 

VUx, y, z) < I4,(x, 1 - 4 </) = 2 x(l - x)(l - <5)^-1 + /3iw - 1)<5(1 - 5)^-^ 

The above achieves its maximum when x = 1/2, i.e., I4,(x, y,z) <Vw (^, 1 — d, <5) • Therefore 

• I4(x,y,z) < • 14 Q, l-S,6\= l + _ 5 )—!. 
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We now prove that for all d E (0, C 2 ], g{w) = i+2/3(^ 1 decreasing on w 

when w > w. Since d <02 = —u)log(l — <5) — 1 < —{w — 1) log(l — 5) — 1 for all w > w, 


dg 

dw 


=- - -(c' + w log(l - 5)) + pSw" “^(1 - 5)"'“^ [w + ( 

- - - 2^^-- -5) - 1) + P5w'^ -^(1 - (w + iw- 

< - -+ («'-!) log(l - <5)) 

< ^(1-^r ^ - 6)^-^d) 


< 0 


w — l){d + w log(l — 5))) 
-l)(log(l-(5)-l)) 


Thus, g{w) is decreasing on w when w > w. In light of this, w^' ■ Vw{x,y,z) can be upper 
bounded by • 14, (^, 1 — (5, (5) for all d E (0, C 2 ]. 

In all, we have 


• Vn,{x,y,z) < re'" -V^ |^-,1 -6,6 
<w^' ■V^(l,l-6,6 




'1 1-^1-^ 

i . ^ 2R ^ 2R 


_ “Y _ _^ 

W ’ W 


w 


TTa-i -'C'—C 


= a/3e2/3 w 


for all w > w and d E (0, C 2 ]. 

——1 

Let c = min{ci,C 2 }, then we have w‘^Vu,(x,y, z) < w‘^^Vw{x,y, z) < ajle'^P if w < w and 
w^Vw{x,y,z) <w'^^Vw{x,y,z)w‘^ < a(3e^i^ iiw>w,i.e., 

((1 - x)x{y^-^ + (1 - z)^-^) + I3{w - l)xy^-^{l - y) + ^{w - 1)(1 - x)(l - z)^-^) < a/3e^"^ 
for all re E N and all x,y,z £ [d, 1 — <5]. 

□ 


We are now ready to prove Lemma [HJ 

Proof of Lemma [771 Let <I>(x) = ^ and ^(x) = f <h(x)dx = Inx. We apply induction on £ = 
max{0, L} to show that, if d < A, then \4>{fv) — <^(/(G, u, L))| < 4:^/ea^ for some constant a <1. 

If £ = 0, note that E [A/3^, thus |(/>(/(G, v,L)) — (j){fv)\ < —2A In (5c- Since |ln(l — x)| < 

2x for all x E (O, , 

\(t>{f{G,v,L)) - (j){fv)\ < -2Aln/3c < 4A ^ ^ < d^/e. 

“T O 
Ve 

We now assume L = £ > 0 and the lemma holds for smaller £. For every i E [d] and j E [tCj], 
we denote rh = Rjj and fO- = R{G^j,Vij,L - [1 + clogi/„ tUiJ), fh = R{G}j,Vij,L - [1 + 

clogi/a^d)- Let r = iir^j)i<j<wi, ir}jh<j<wi)ie[d], ? = iirij)i<j<wi, iHjh<j<wi)i(^[d]- Let /(r) = 
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0 ^1 
1 /I - \ '"u n'^i «.7 

11-1 i-(i-ft)^n7i.^ 

' ,1 ' ij 


, then it follows from PropositionOthat for some f = {{r^j)i<j<wi, {Hj)2<j<wi)i^[d] 


il 


where each € [XP^,X/3^ ^], 


\cP{R,)-mG,v,L))\ < EE 


(♦) 


<^(/) 

°) 

vJ = i ' 

d I Wi 


1 ^ $(r' 

j=l \ 7 = 1 1 : 


9/(r) 


dr% 


j=2 ^ 


<9/(r) 


9rl. 


|<^H) - (t>{Hj)\ 


j=i yj=i 1 
< 4-^60^. 


9/(r) 


5r0. 


, V ^(/) 


9/(r) 


9rh 


a 


L-[l+clogi/„«;iJ 


(4|fc) follows from the induction hypothesis and {^) is due to Lemma [12] for all d < A. 
Then the lemma follows from Proposition [T] since 


\K-R{G,v,L)\ = 


1 


<l)(x) 


\<PiR,)-cP{RiG,v,L))\ 


for some x G [A/3^, A/3, 


A \ fl-Aj 


< e'^X ^ ■ 4^/ea^ 


= 4X~^e2+^a^. 

The inequality above is due to ld~^ = 


-A 


< e>^. 


□ 
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